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Introduction 

This  paper  discusses  several  main  concepts  in  linear  programming, 
the  purpose  of  which  is  to  supplement  the  textbook  teaching  of  these 
concepts  to  further  the  students'  understanding.  These  main  concepts 
include  bases,  extreme  points,  the  simplex  algorithm,  and  sensitivity 
analysis.  Before  any  of  these  concepts  are  discussed,  a  necessary  review 
of  linear  algebra  is  done.  The  ideas  presented  here  should  give  the 
professor  additional  knowledge  about  how  to  successfully  teach  the 
students  these  concepts.  Computer  programs  are  developed  in  MOR/ML  in 
order  to  aid  in  these  discussions.  MOR/ML  is  a  computer  programming 
language  which  has  the  syntax  necessary  to  facilitate  these  concepts. 
MOR/ML  is  a  "set"  structured  language  which  allows  for  the  programming 
of  matrices  and  sets.  This  structure  makes  it  possible  to  formulate  the 
programs  dealing  with  linear  programming.  The  coded  programs  in  MOR/ML 
and  the  output  for  these  programs  are  in  Appendix  A.  The  students  will  be 
able  to  understand  these  concepts  oy  learning  and  working  with  the 
proposed  computer  programs  with  the  aid  of  the  professor. 

Four  programs  are  developed  to  further  the  understanding  of  the 
concepts  of  bases  and  extreme  points  and  how  these  concepts  are  related. 
The  emphasis  of  these  programs  is  to  reveal  and  show  the  importance  of 
their  relationship.  The  first  program  listed  in  Appendix  A.1  generates  all 
possible  bases.  The  second  program  listed  in  Appendix  A. 2  generates  all 
possible  extreme  points.  The  third  program  listed  in  Appendix  A. 3 
generates  a  feasible  extreme  point  given  a  feasible  basis,  and  the  final 
program  listed  in  Appendix  A.4  generates  a  feasible  basis  given  a  feasible 
extreme  point.  These  four  programs  will  help  the  students  understand 
what  extreme  points  and  bases  are,  how  they  relate  to  each  other,  and  why 
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understanding  of  their  relationship  is  crucial  in  linear  programming. 

The  discussion  of  the  simplex  algorithm  is  based  on  a  program 
developed  for  the  purpose  of  helping  the  students  learn  the  algorithm.  The 
program  is  in  Appendix  A. 5.  This  program  and  manipulation  of  it  will 
enable  the  students  to  learn  the  rules  and  steps  of  the  algorithm.  The 
program  will  also  help  students  understand  how  the  simplex  algorithm  is 
driven  by  extreme  points  but  uses  basic  feasible  solutions.  Students 
typically  have  difficulty  relating  these  two  concepts.  This  program  is 
altered  in  order  to  show  how  the  students  can  manipulate  the  program  in 
order  to  select  the  entering  and  leaving  variable.  The  altered  program  is 
in  Appendix  A.6. 

The  final  set  of  programs  in  Appendix  A. 7  are  developed  for 
sensitivity  analysis  on  the  original  linear  program.  For  all  of  the 
programs,  the  students  will  find  the  range  for  which  the  change  can  occur 
in  order  to  maintain  optimality  and  feasibility  of  the  solution.  The 
specific  range  is  found  by  manipulating  the  part  of  the  optimal 
transformed  system  which  is  affected. 

The  first  of  these  programs  performs  a  sensitivity  analysis  on  the 
right-hand  side  (RHS).  The  second  program  performs  a  sensitivity 
analysis  on  the  basic  and  non-basic  cost  coefficients.  The  last  program 
does  a  sensitivity  analysis  on  the  variable  bounds,  which  are  generally 
greater  than  or  equal  to  zero. 

These  programs  are  developed  to  be  used  in  parallel  with  the  text  in 
order  to  aid  the  students  in  the  understanding  of  these  concepts. 


Systems  of  Equations 

Solving  systems  of  linear  equations  is  important  when  talking  about 
key  linear  programming  concepts  such  as  bases  and  extreme  points.  Three 
systems  of  linear  equations  are  examined  to  introduce  these  two  concepts. 

The  first  set  of  linear  equations  is  of  the  form  Ax=b  with  the  x 
variables  unrestricted  in  sign  (uis).  For  purposes  of  this  discussion,  a 
system  of  independent  linear  equations  with  the  same  number  of  equations 
as  unknowns  produces  a  unique  solution.  An  example  of  a  system  with  two 
unknowns  and  two  equations  with  a  unique  solution  is: 

3x1  +  4x2  =  6 
2x1  +  x2  =  4 

This  system  of  equations  gives  the  solution  by  simple  substitution,  x1  =2, 
x2  =  0. 

Another  system  of  the  same  form  Ax=b,  with  the  x  variables 
unrestricted  in  sign,  is  a  system  with  more  unknowns  than  equations. 

This  particular  system  produces  infinite  solutions.  An  example  of  a 
system  with  only  one  equation  with  infinite  solutions  is  a  line.  A  line  is 
defined  with  two  unknowns  and  one  equation  such  as  5x1  +  2x2  =  18.  In 
order  to  find  the  solution  to  this  system,  xl  is  solved  for  in  terms  of  x2. 
For  example,  xl  =  18/5  -  2/5x2.  This  equation  could  have  also  been 
solved  for  x2  in  terms  of  xl.  Both  of  these  solution  spaces  produce  an 
infinite  number  of  solutions.  A  graphical  representation  is  shown  in 
Figure  1. 
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The  next  system  of  linear  equations  of  the  form  Ax  <=  b  is 
represented  as  one  equation  in  Figure  2.  For  the  purpose  of  this 
discussion,  a  system  of  linear  equations  is  equivalent  to  a  system  of 
constraints  in  linear  programming.  The  use  of  one  equation  versus  a 
system  of  equations  or  constraints  is  used  for  ease  of  graphical 
understanding.  This  system  consisting  of  one  constraint  can  be 
transformed  into  an  equality  constraint,  Ax  +  s  =  b.  The  extension  of  one 
constraint  to  m  constraints  redefines  the  feasible  solution  space.  These 
concepts  as  applied  to  one  constraint  apply  to  m  constraints  alike.  A 
slack  variable  must  be  added  because  of  the  original  inequality.  The  slack 
variable  must  be  s  >=0  because  of  the  nature  of  the  inequality.  The 
concept  of  slack  variables  can  be  explained  graphically.  For  ease  of 
understanding,  the  following  systems  of  equations  each  consist  of  one 
constraint  or  line.  Figure  3  represents  a  constraint  with  the  slack 
variable  equal  to  zero.  Figure  4  represents  two  parallel  constraints  each 


representing  a  different  system  where  b'<b.  The  slack  variable  associated 
with  the  system  Ax  =  b'  is  s'=0,  but  the  slack  variable  associated  with 
Ax  <*  b  is  s  which  is  greater  than  zero.  The  value  of  s  is  equal  to  the 
distance  between  b  and  b',  so  s  =  b  -  b*.  This  figure  only  represents  one 
value  for  the  slack  variable,  s.  The  slack  variable  associated  with  the  line 
Ax  +  s  =  b  in  Figure  4  can  therefore  be  thought  of  as  the  variable  which 
takes  on  the  value  needed  to  make  the  original  inequality  constraint  an 
equality  constraint.  In  order  to  solve  a  linear  program,  the  original 
system  of  linear  inequality  constraints  is  transformed  to  equality 
constraints.  In  order  to  do  this,  slack  variables  are  introduced  into  the 
inequality  constraints. 
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Figure  3. 


The  final  system  of  linear  equations  is  of  the  form  Ax  <=  b  with 
both  of  the  x  and  slack  variables  greater  than  or  equal  to  zero.  This 
system  consists  of  one  constraint  for  graphical  purposes  but  is  extended 
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to  m  constraints  for  general  linear  programs.  The  graphical 
representation  for  one  constraint  is  shown  in  Figure  5. 


This  particular  system  introduces  the  concept  of  extreme  points  which 
are  simply  the  intersection  of  n  independent  constraints,  where  n  is  the 
number  of  x  variables.  The  graphical  picture  above  is  two  dimensional 
with  axes  constraints,  x  >=  0,  and  one  linear  constraint,  Ax=b.  The 
intersections  of  the  constraints  represent  three  extreme  points.  This 
linear  algebra  discussion  will  aid  the  students'  understanding  of  the 
following  section,  bases  and  extreme  points. 
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Bases  and  Extreme  Points 

Bases  and  extren-'*  points  come  from  a  system  of  equations  of  a 
genera!  form,  Ax  =  b  where  A  e  R%R’^,  b  e  R^,  and  x  e  R^.  A  basis  can  be 
defined  as  ?  set  of  m  independent  vectors  of  the  system  {xi  Ax  <=  b}, 
which  represents  a  solution  space.  An  extreme  point  is  the  intersection 
of  n  independent  constraints,  where  n  is  the  number  of  x  variables 
excluding  slack  variables.  The  understanding  of  the  relationship  that 
exists  between  extreme  points  and  bases  is  necessary  for  the  complete 
understanding  of  the  simplex  algorithm.  For  this  reason  more  time  should 
be  devoted  to  the  discussion  of  this  relationship. 

The  common  method  of  introducing  students  to  linear  programming 
and  its  solution  begins  with  a  graphical  representation  showing  all 
extreme  points  and  the  feasible  region.  The  students  are  them  taught  the 
Simplex  Method  which  is  an  algorithm  used  to  solve  linear  programs. 

Hillier  &  Lieberman  begin  the  discussion  of  the  Simplex  Method  with  a 
graphical  representation  of  the  feasible  region  (H&L,  Figure  4.1).  Directly 
following  this  graphical  representation,  Hillier  &  Lieberman  discuss 
setting  up  the  algorithm  and  the  operations  of  the  algorithm 
(H&L,  Sections  4.2,3).  By  teaching  the  simplex  algorithm  directly 
following  the  graphical  representation,  the  students  never  really 
understand  how  the  simplex  algorithm  operates.  The  concept  of  traveling 
from  one  extreme  point  to  the  next  until  the  optimal  point  is  found  is 
discussed  from  the  graphical  representation  of  extreme  points,  the 
feasible  region,  and  the  gradient  of  the  objective  function.  Students  can 
understand  how  the  simplex  algorithm  finds  the  optimal  point  in  a  linear 
program,  but  they  may  not  know  that  the  simplex  algorithm  actually  uses 
bases  and  not  extreme  points  to  get  to  the  optimum.  The  one-to-one 
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relationship  between  extreme  points  and  bases  is  what  allows  the 
explanation  of  the  Simplex  Method  to  be  done  by  a  graphical  representation 
of  the  feasible  region.  The  purpose  of  this  discussion  is  to  fill  the  "gap" 
which  exists  between  the  graphical  representation  of  the  feasible  region 
and  the  simplex  algorithm. 

The  one-to-one  relationship  which  exists  between  bases  and 
extreme  points  depends  on  whether  the  solution  is  non-degenerate.  A  non¬ 
degenerate  solution  gives  a  unique  extreme  point  for  each  basis.  On  the 
other  hand,  a  degenerate  solution  is  one  in  which  two  or  more  bases 
represent  the  same  extreme  point.  The  non-degenerate  case  is  discussed. 

When  a  non-degenerate  solution  exists,  exactly  n  independent 
constraints  intersect  at  each  extreme  point  and  exactly  one  basis  is 
associated  with  this  extreme  point;  therefore,  a  one-to-one  relationship 
exists  between  bases  and  extreme  points.  In  other  words,  each  basis 
corresponds  to  one  and  only  one  extreme  point.  In  order  to  actually 
understand  how  these  two  concepts  are  related,  one  must  generate  all 
possible  bases  and  extreme  points. 

Generation  of  bases 

The  general  system  of  linear  equations  used  for  this  section  is  of 
the  form  Ax  +  s  =  b  with  x,s  >=  0.  The  possible  bases  are  found  by  taking 
the  combination  of  n+m  variables  taken  m  at  a  time,  where  n  is  the  number 
of  x  variables  and  m  is  the  number  of  constraints  or  slack  variables,  s.  A 
point  should  be  noted  here.  A  variable  represents  a  column,  so  when  all 
possible  basis  are  found,  this  is  in  essence  the  possible  combination  of 
columns.  The  program  in  Appendix  A.1  generates  all  possible  bases.  The 
program  requires  as  input  the  A  matrix  which  is  m  x  (m+n),  the  b  column 
vector  which  is  m  x  1  transposed  in  ML  to  a  1  x  m  row  vector,  the  number 
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of  X  variables,  and  the  number  of  slack  variables,  s.  In  order  to  understand 
and  work  with  this  program,  a  few  MOR/ML  commands  are  introduced. 


MOR/ML  CONCEPTS 


[*  *] 

I  } 

{{  }A  }} 

Range[a,b] 

Subsets[a,b] 


Cardinality[a] 

Extract[a,b] 

GetCo)umn[a,b] 

lnverse[a] 

Append[a,b3 

lnsert[a,b,c] 

Drop[a,b] 

Print["  "3 


Comment  statement 
Vector  (List) 

Matrix  (List  of  lists'' 

Gives  a  list  of  whole  numbers  from  a  to  b 
Gives  a  list  consisting  of  lists  of  length  b. 

These  lists  are  the  possible  combinations  of  a 
things  taken  b  at  a  time 
Gives  the  number  of  elements  in  a  list 
Extracts  the  bth  element  from  the  list,  a 
Gives  a  list  of  b  columns  from  the  matrix  a 
Gives  the  inverse  of  the  matrix,  a 
Gives  a  list  with  b  added  to  the  end  of  a 
Inserts  into  the  list,  a,  the  number,  b,  into  the 
cth  position 

Gives  a  list  with  b  elements  subtracted  from  the 
list,  a 

Prints  elements  enclosed  in  "  " 


An  exercise  left  for  the  students  is  to  adjust  the  program  to  give  only 
basic  feasible  solutions.  A  feasible  basis  gives  only  positive  solutions 
for  all  of  the  variables.  In  order  to  obtain  only  basic  feasible  solutions, 
eliminate  any  bases  which  give  negative  solutions  for  one  or  more 
variables. 
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Generation  of  extreme  points 

In  order  to  understand  the  one-to-one  relationship  between  extreme 
points  and  bases,  all  possible  extreme  points  need  to  be  generated  from 
the  same  system  of  linear  equations  that  generated  all  possible  feasible 
bases.  In  order  to  generate  all  possible  extreme  points,  the  m+n 
constraints  including  non-negativity  constraints  and  the  x  variables 
excluding  slack  variables  are  required.  The  procedure  is  to  find  all 
possible  combinations  of  m+n  constraints  taken  n  at  a  time  where  m+n  is 
the  total  number  of  constraints  including  non-negativity,  and  n  is  the 
number  of  x  variables  excluding  the  slack  variables.  The  solution  is  then 
found  for  each  of  the  n  independent  constraints  giving  an  extreme  point, 
which  is  the  intersection  of  these  n  independent  constraints.  An  MOR/ML 
computer  program  listed  in  Appendix  A.2  is  written  to  generate  all 
possible  extreme  points.  This  program  needs  as  input  the  A  matrix  which 
is  (m+n)  x  n,  the  b  column  vector  which  is  (m+n)  x  1  transposed  to  a  1  x 
(m+n)  row  vector  for  use  in  ML,  the  number  of  x  variables,  and  the  number 
of  constraints.  An  exercise  left  for  the  student  is  to  change  the  program 
in  order  to  list  only  the  feasible  extreme  points.  An  extreme  point  is 
Infeasible  if  one  or  more  constraints  are  violated  by  the  extreme  point. 

In  the  case  of  non-degeneracy,  an  extreme  point  is  associated  with 
one  and  only  one  basis.  Once  an  extreme  point  is  known,  the  respective 
basis  is  also  known  and  vice  versa.  The  constraints  which  represent  an 
extreme  point  are  active  and  of  the  form  Ax  +  s  =  b  where  the  respective 
slack  variables,  s,  corresponding  to  the  active  constraints  are  equal  to 
zero.  The  additional  non-negativity  constraints  for  two  dimensions  for 
example  are  x1  >=  0  and  x2  >=  0  have  no  slack  variables  associated  with 


them.  Therefore,  the  total  number  of  constraints  is  m+n.  When  an 


extreme  point  lies  on  an  axis,  say  the  xl  axis,  the  respective  intersecting 
constraints  in  two  dimensions  contain  x2  =  0  and  one  of  the  m  constraints. 
The  basis  associated  with  an  extreme  point  does  not  contain  the  slack 
variables  associated  with  the  respective  intersecting  constraints  because 
these  are  equal  to  zero.  When  an  extreme  point  lies  on  an  axis,  say  the  xl 
axis,  the  basis  corresponding  to  this  extreme  point  does  not  contain  the 
variable  x2  because  the  constraint  x2  >=  0  is  tight.  Two  MOR/ML  programs 
are  constructed  to  further  the  understanding  of  this  one-to-one 
relationship  between  bases  and  extreme  points. 

Generation  of  an  extreme  point  given  a  basis 

The  program  listed  in  Appendix  A.3  generates  an  extreme  point  for  a 
given  basis.  This  program  requires  several  input  quantities.  These 
include  the  A  matrix  which  contains  the  slack  variables  so  it  has 
dimensions  m  x  (m+n),  the  b  column  vector  which  is  m  x  1  and  is 
transposed  to  a  1  x  m  row  vector  in  MOR/ML,  the  given  basis  which  is  a 
1  X  m  row  vector,  the  number  of  x  variables  excluding  slack  variables,  and 
the  number  of  constraints  which  is  the  number  of  slack  variables  added. 
The  only  additional  MOR/ML  command  required  for  understanding  of  this 
program  which  has  not  been  introduced  is  the  APPEND  command. 
APPEND[a,b]  simply  adds  on  to  the  list,  a,  the  element  b.  This  program 
assumes  the  given  basis  Is  feasible  and  gives  the  basic  feasible  solution 
along  with  the  extreme  point  associated  with  the  given  basis. 

Generation  of  a  basis  for  a  given  extreme  point 

The  program  listed  in  Appendix  A.4  generates  a  basis  for  a  given 
extreme  point.  The  required  input  quantities  are  the  matrix  A  which  is  m 
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X  (m+n),  the  b  column  vector  which  is  m  x  1  and  is  transposed  to  a  row 
vector  for  use  in  MOR/ML,  the  number  of  x  variables  excluding  the  slack 
variables,  the  number  of  constraints,  and  the  given  extreme  point  which  is 
1  X  n.  This  program  assumes  the  given  extreme  point  is  feasible  so  the 
generated  basis  and  basic  feasible  solution  are  also  feasible.  These  two 
programs  will  aid  the  students  in  understanding  the  relationship  between 
a  basis  and  an  extreme  point.  For  an  exercise,  the  student  will  determine 
the  feasible  bases  and  extreme  points  and  use  the  MOR/ML  programs  to 
further  the  understanding  of  these  concepts.  The  case  of  degeneracy 
exists  when  an  extreme  point  is  represented  by  two  or  more  bases 
resulting  in  one  or  more  basic  variables  equaling  zero.  Therefore,  the  one- 
to-one  relationship  does  not  exist  as  in  the  case  of  non-degeneracy.  The 
MOR/ML  programs  will  assist  the  students  in  understanding  the  concept  of 
degeneracy.  The  students  should  first  generate  all  possible  bases  and 
extreme  points  and  determine  which  are  feasible.  Next,  the  program  in 
Appendix  A. 3,  generation  of  an  extreme  point  given  a  feasible  basis,  should 
be  run.  This  will  give  the  extreme  point  associated  with  each  basis.  What 
the  students  will  observe  is  that  the  degenerate  extreme  point  is 
generated  by  two  or  more  bases. 
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Simplex  Algorithm 

The  simplex  algorithm  is  presented  by  a  program  developed  to 
further  the  students'  understanding  of  the  algorithm.  This  understanding 
will  come  by  manipulation  of  the  program  in  order  to  learn  the  simplex 
rules  by  observation  of  the  results.  The  simplex  algorithm  can  be  thought 
of  as  a  function  which  calls  three  separate  functions, 
getEnteringVariable,  getLeavingVariable,  and  doPivot.  This  program  is 
listed  in  Appendix  A. 5.  This  discussion  will  be  based  extensively  on  the 
program  itself.  This  program  will  allow  the  students  to  change  a  basis, 
the  collection  of  basic  variables.  The  students  can  also  select  the 
entering  variable,  which  is  the  function  call  getEnteringVariable,  and 
examine  the  resulting  change  in  the  objective  function  value.  The 
students  should  observe  which  of  the  possible  entering  variables  give  a 
better  objective  function  value.  Lastly,  the  students  can  also  select  a 
leaving  variable,  which  is  the  function  call,  getLeavingVariable, 
arbitrarily  and  check  for  infeasibility.  In  order  to  understand  how  the 
leaving  variable  should  be  selected,  the  students  should  continue  to  select 
a  leaving  variable  until  infeasibility  occurs,  assuming  no  unbounded 
solutions  and  a  non-degenerate  solution. 

Introduction  to  the  simplex  algorithm 

The  simplex  algorithm  is  based  on  the  standard  system  of  linear 
constraints.  Ax  +  s  =  b,  x,s  >  =  0.  Where  s  is  the  collection  of  slack 
variables.  This  system  of  linear  equations  consists  of  rows  and  columns, 
where  the  rows  represent  the  constraints  and  the  columns  represent  the 
variables.  A  representation  of  a  standard  linear  program  in  vector  and 
matrix  notation  is  the  following: 
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optimize  Z  =  C0*Xg  + 
subject  to  B*Xg  +  N*X^  =  b 

Xg  >=  0,  X^  >=  0 

Where  Cg  is  a  vector  of  basic  variable  cost  coefficients.  These 

variables  are  the  original  variables-mo  slacks, 
is  a  vector  of  non-basic  variable  coefficients.  These 

variables  are  the  slack  variables. 

Xg  is  a  vector  of  basic  variables. 

Xp  is  a  vector  of  non-basic  variables—slack  variables. 

B  is  a  matrix  of  constraint  coefficients  of  the  basic 
variables. 

N  is  a  matrix  of  constraint  coefficients  of  the  non-basic 
variables. 

b  is  the  right-hand  side  vector  of  the  constraints. 

The  simplex  algorithm  is  an  iterative  algorithm  in  which  the  basis 
changes  at  each  iteration.  The  algorithm  is  continued  until  an  optimal 
basis  is  found.  Each  constraint  or  row  is  representative  of  a  basic 
variable.  The  basis  is  changed  by  simple  row  operations.  Each  iteration 
consists  of  the  completion  of  three  basic  function  calls  from  the  main 
function,  simplexAlgorlthm.  The  first  function  call,  getEnteringVariable, 
selects  which  of  the  variables  not  In  the  current  basis,  also  called  non- 
basic  variables,  should  enter  the  basis.  The  second  function  call, 
getLeavingVariable,  determines  which  of  the  variables  currently  in  the 
basis,  also  called  basic  variables,  should  exit  the  basis  and  become  non- 
basic.  The  third  function,  doPivot,  performs  row  operations  to  change  the 
basis.  Once  the  optimal  basis  is  found  the  algorithm  is  terminated. 
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When  the  algorithm  begins,  the  linear  program  can  be  represented  as 
a  transformed  system  in  vector  and  matrix  notation.  This  standard 
notation  also  applies  to  the  format  of  the  system  at  optimality.  The  three 
function  calls  in  the  program  listed  in  Appendix  A.  5  are  required  to 
complete  an  iteration  and  each  use  selected  portions  of  the  transformed 
system.  The  transformed  system  is  shown  below: 

optimize  Z  =  -  C0B’^N)*X^  +  CQB’^b 

subject  to  l*Xg  +  B'^N*X^  =  B"^b 

Xg  >=  0,  Xj^  >=  0 

Where  (C^  -  CgB‘^N)  is  the  vector  of  reduced  costs. 

CgB"^b  is  the  objective  function  value 

B'^b  is  the  vector  of  the  optimal  right-hand  side 

(RHS)  values. 

I  is  the  identity  matrix 

.1 

B  N  is  the  matrix  of  non-basic  variable 

constraint  coefficients. 

Selection  of  the  entering  variable 

The  portion  of  the  transformed  system  considered  in  the  selection  of 
the  entering  variable  is  (Cj.,-  CgB'^N)*X^,  the  reduced  costs.  The  function 

call,  getEnteringVariable,  requires  as  input  the  vector  of  reduced  costs 
above  and  returns  the  pivot  column  number.  This  number  corresponds  to 
the  position  of  the  selected  entering  variable  in  the  reduced  costs  vector. 
The  function  returns  a  zero  if  the  optimal  has  been  obtained.  By  selecting 
which  of  the  non-basic  variables  should  enter  the  basis,  the  students 
should  observe  different  changes  in  the  objective  function  value.  Once  all 
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possible  non-basic  variables  have  been  selected  to  enter  the  basis,  the 
rule  for  an  entering  variable  should  be  apparent.  A  graphical 
representation  will  also  reveal  which  variable  should  enter  based  on  the 
gradient  of  the  objective  function  and  which  extreme  point  is  optimal. 

The  simplex  program  can  be  edited  in  order  to  select  the  entering  variable 
and  examine  the  results. 

Selection  of  the  exiting  variable 

The  portions  of  the  transformed  system  considered  in  the  selection 
of  the  exiting  variable  include  the  i^*^  column  of  the  non-basic 

entering  variable  and  B'^b.  The  function,  getLeavingVariable,  requires  as 
input  these  two  vectors  and  returns  the  row  position  of  the  selected 
leaving  variable.  If  the  problem  is  unbounded,  the  function  returns  a  zero. 
The  students  can  select  the  leaving  basic  variable  by  editing  the  simplex 
program.  The  leaving  variable  corresponds  to  a  particular  constraint. 

Once  the  students  select  the  variable  to  leave,  a  pivot  is  performed  and 
the  students  can  observe  the  results.  If  the  wrong  leaving  variable  is 
selected  and  one  or  more  constraints  are  violated,  the  solution  will  be 
Infeasible,  assuming  non-degeneracy  and  bounded  solutions.  A  graphical 
representation  will  show  which  variable  should  leave  given  an  entering 
variable.  The  rule  for  selecting  the  leaving  variable  should  become 
apparent. 

A  graphical  representation  will  reveal  how  a  change  of  basis  in  the 
simplex  algorithm  relates  to  moving  from  one  extreme  point  to  another.  A 
pivot  is  the  movement  from  one  extreme  point  to  another.  The  function 
call,  doPivot,  performs  the  necessary  row  operations  in  order  to  move 
from  one  extreme  point  to  another  and  update  the  current  basis.  The 
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changing  of  a  basis  involves  inclusion  of  the  selected  entering  variable 
into  the  basis  and  the  elimination  of  the  selected  exiting  variable  from 
the  basis.  The  function,  doPivot,  requires  as  input  the  column  position  of 
the  entering  variable,  the  row  position  of  the  exiting  variable,  and  the  i^^ 
column  of  B'^N  corresponding  to  the  entering  variable.  The  students 
should  observe  that  each  change  of  basis  moves  from  one  extreme  point  to 
another  in  the  case  of  non-degeneracy.  In  order  for  the  students  to 
observe  that  the  simplex  algorithm  changes  a  basis  at  each  extreme  point, 
the  students  are  urged  to  graphically  follow  the  algorithm  at  each 
iteration.  As  the  students  perform  this  exercise,  they  should  observe  that 
a  unique  basis  is  associated  with  each  individual  extreme  point. 

Therefore,  th^  concept  that  the  simplex  algorithm  is  driven  by  extreme 
points  but  uses  bases  In  order  to  travel  from  one  extreme  point  to  another 
should  be  better  understood.  It  should  be  clear  to  the  students  that  the 
graphical  and  tableau  representation  of  the  simplex  algorithm  are  not  the 
same  concept,  but  are  directly  related.  In  the  process  of  this  exercise  the 
students  will  also  observe  that  in  the  case  of  a  degenerate  point,  a  change 
of  basis  will  remain  at  the  same  extreme  point.  This  happens  because 
more  than  one  bases  represent  the  same  extreme  point. 


18 


I 

i 

I 

I 

I 

I 

I 


Sensitivity  Analysis 

Sensitivity  analysis  is  a  vital  tool  in  the  analysis  of  any  linear 
program.  MOR/ML  programs  are  developed  in  order  to  help  students 
understand  what  sensitivity  analysis  is  and  how  simple  the  concept  is  to 
learn.  When  a  large  linear  program  is  being  solved  and  interpreted,  one 
may  wish  to  know  how  much  the  original  program  can  change  without 
changing  the  optimal  basis  or  becoming  infeasible.  The  purpose  of 
sensitivity  analysis  is  to  indicate  how  much  a  particular  part  of  the 
original  program  can  change  before  the  problem  needs  to  be  resolved. 

Three  sections  of  a  linear  program  are  discussed  in  this  section  and  in  the 
programs. 

The  right-hand  side  can  easily  change  once  a  problem  is  solved.  If 
the  problem  is  very  large  it  may  take  days  and  money  to  resolve  the 
slightly  modified  linear  program.  Instead  a  range  is  found  on  how  much  a 
right-hand  side  element  can  change  and  still  maintain  the  feasibility  and 
the  current  optimal  basis.  This  is  the  purpose  of  sensitivity  analysis. 
Another  part  of  a  linear  program  which  is  discussed  is  that  of  the  original 
cost  coefficients.  A  range  can  also  be  developed  for  basic  and  non-basic 
cost  coefficients.  The  last  item  discussed  is  that  of  the  bounds  of  basic 
and  non-basic  variables.  Sensitivity  analysis  can  only  indicate  a  range  for 
which  one  element  can  change.  When  changes  on  two  or  more  elements 
occur,  this  becomes  parametric  analysis.  A  range  can  also  be  determined 
for  which  the  two  or  more  elements  can  change,  but  once  the  range  is 
violated,  one  can  only  give  an  upper  or  lower  bound  on  the  objective 
function  value.  When  two  or  more  elements  are  changed  outside  of  the 
optimal  range,  the  problem  may  or  may  not  remain  optimal. 
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Additional  MOR/ML  commands 

MaxList[a]  Returns  the  maximum  element  in  the  list,  a,  and  the 
position  in  which  the  maximum  occurs  in  the  list 
MinList[a3  Returns  the  minimum  element  in  the  list,  a,  and  the 
position  in  which  the  maximum  occurs  in  the  list 
Map[a,b]  Applies  the  function,  a,  to  the  list,  b 

This  discussion  uses  the  same  notation  as  discussed  above  for  the  general 
linear  program  and  transformed/optimal  linear  program. 

Sensitivity  analysis  on  the  riaht-hand  side 

A  range  can  be  determined  for  which  a  particular  element  of  the 

original  right-hand  side  can  change  to  maintain  feasibility  and  the  current 

optimal  basis.  In  order  for  the  current  optimal  basis  to  remain  feasible, 

the  right-hand  side  (RHS)  must  be  greater  than  or  equal  to  zero  after  the 

change  occurs  to  a  particular  element  The  current  optimal  RHS  is  B'^b. 

To  ensure  that  the  RHS  will  remain  feasible  after  a  change  occurs,  the 

change  must  be  in  some  range.  In  order  to  determine  the  range  in  which 

the  change  can  occur,  the  b  vector  becomes  b  +  ed.  e  represents  how 

much  the  original  element  of  the  RHS  changes,  and  d  Is  a  vector  of  O's  and 

a  1  in  the  position  of  the  changing  element  The  current  RHS  then  becomes 
-1  -1 

B  b  +  0B  d  which  must  be  greater  than  or  equal  to  zero.  With  some 
algebra,  the  range  on  e  becomes  O  >=  -B‘^b/B'^d.  Two  cases  arise  here. 

1.  B'^d  is  >  0.  0  >  =  -B‘^b/B"^d  the  maximum  of  these 

inequalities  is  the  lower  bound  for  e 
can  increase  without  bound. 
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2.  B”^d  Is  <  0.  d  <  =  -B  ^b/B‘^d  the  minimum  of  these 


inequalities  is  the  upper  bound  for  o.  e 
can  decrease  without  bound. 

It  should  be  obvious  that  when  B"^d  Is  equal  to  zero,  d  can  increase  or 
decrease  without  bound. 

The  program  listed  in  Appendix  A,7  performs  a  sensitivity  analysis 
on  the  RHS  and  requires  as  input  the  current  B“\  the  current  RHS,  and  the 
vector  d  indicating  which  element  of  the  original  RHS  is  to  be  changed. 

The  determination  of  the  bounds  on  e  are  the  same  for  a  minimum  or 
maximum  optimization  problem. 

Sensitivity  atiaivsis  on  the  cost  coefficients 

The  determination  of^  for  the  cost  coefficients  depends  on  whether 

the  type  of  problem  is  a  minimization  or  maximization  problem.  For  both 

types  of  problems,  the  part  of  the  optimal  system  which  will  be  affected 
by  the  change  Is  the  reduced  costs.  These  are  (C^  -  CgB_.|N)*X^  at 

optimality.  Non-basic  and  basic  original  cost  coefficients  can  be  changed. 

Changes  made  to  any  of  the  cost  coefficients  will  not  affect  the 

feasibility  of  the  problem,  only  the  optimality  of  the  problem. 

The  changes  to  non-basic  cost  coefficients  changes  to 

+  0d^  in  the  reduced  costs,  thus  extending  the  reduced  costs  to 

{ (Cp  +  0d^)  -  CgB'^N  }.  The  range  of  d  depends  on  if  the  problem  is  a 

minimization  or  maximization  problem. 
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MINIMUM/NON-BASIC  COST  COEFFICIENTS 

For  a  minimization  problem,  the  reduced  costs  are  greater  than  or 
equal  to  zero  at  optimality.  A  reduced  cost  can  equal  zero,  in  which  case 
the  particular  problem  would  have  multiple  optimal  solutions.  The 

reduced  costs  must  remain  >  =  0  in  order  to  maintain  optimality,  thus, 

{ (C^  +  0dp)  -  CgB'^N  }  >=  0.  With  some  algebra,  &  >=  CgB'^N  -  C^.  In 

other  words,  d  can  only  decrease  by  the  value  of  the  variable's  reduced 
cost,  d  can  increase  without  bound. 

MAXIMUM/NON-BASIC  COST  COEFFICIENTS 

For  a  maximization  problem,  the  reduced  costs  are  less  than  or  equal 
to  zero  at  optimality.  Thus,  {  (C^  +  ^d^^)  -  CgB'^  N  }  <=  0  for  optimality. 

-1 

With  some  algebra,  o  <=  CgB  N  -  C^.  0  can  only  increase  by  the  value  of 
the  variable's  reduced  cost.  0  can  decrease  without  bound. 

MINIMUM/BASIC  COST  COEFFICIENTS 

The  reduced  costs  are  greater  than  or  equal  to  zero  at  optimality. 

The  element  of  the  reduced  costs  which  changes  is  Cg.  Thus,  the  reduced 

cost  are  extended  to  incorporate  Cg  +  edg  to  {  C^  -  (Cg  +  f:ydg)B‘^N  }  >=  0. 

With  some  algebra,  this  reduces  to  0<=  (C^  -  CgB‘^N)/B"^N  where  B’^N  is 

a  vector  of  the  coefficients  of  the  non-basic  variables  in  the  row  of  the 
basic  variable.  Two  cases  are  considered  here. 

1.  B'^N  >  0.  0  <~  (C^  -  CgB'^N)/B'^N  the  minimum  of  these 

inequalities  is  the  upper  bound  for  ff.  0  can 
decrease  without  bound. 
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2.  B'^N  <0.  e  >=  (Cj^  -  CgB‘^N)/B‘^N  the  maximum  of  these 

inequalities  is  the  lower  bound  for  o  can 
increase  without  bound. 

It  should  be  obvious  that  if  B'^N  is  equal  to  zero,  e  can  increase  or 
decrease  without  bound. 

MAXIMUM/BASIC  COST  COEFFICIENTS 

The  reduced  costs  are  less  than  or  equal  to  zero  at  optimality.  The 
element  of  the  reduced  costs  which  changes  is  Cg.  Thus,  the  reduced  cost 

are  extended  to  incorporate  Cg  +  0dg  to  |  C^  -  (Cg  +  edg)B’^N  }  <=  0. 

With  some  algebra,  this  reduces  to  <9  >=  (C^  -  CgB‘^N)/B"^N  where  B’^N 

is  a  vector  of  the  coefficients  of  the  non-basic  variables  in  the  row  of  the 
basic  variable.  Two  cases  are  considered  here. 

1.  B”^N  <  0.  e  <=  (Cp  -  CgB'^N)/B'^N  the  minimum  of  these 

inequalities  is  the  upper  bound  for  e.  e  can 
decrease  without  bound. 

2.  B'^N  >0.  d  >=  (C^  -  CgB‘^N)/B’^N  the  maximum  of  these 

inequalities  is  the  lower  bound  for  e .  e  can 
increase  without  bound. 

It  should  be  obvious  that  if  B"^N  is  equal  to  zero,  e  can  Increase  or 
decrease  without  bound. 

The  MOR/ML  program  listed  in  Appendix  A.  7  performs  a  sensitivity 
analysis  on  the  non-basic  and  basic  cost  coefficients.  The  non-basic  cost 
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coefficient  analysis  requires  as  input  the  vector  of  reduced  costs  and  the 
position  in  the  reduced  cost's  vector  of  the  variable  of  interest.  The  basic 
cost  coefficient  analysis  requires  as  input  the  vector  of  reduced  costs  and 
the  vector  of  coefficients  of  non-basic  variables  from  the  row  of  the 
basic  variable. 

Sensitivity  Analysis  on  the  variable  bounds 
A  standard  linear  program  requires  that  basic  and  non-basic 
variables  be  greater  than  or  equal  to  zero.  The  range  for  which  a  variable 
bound  can  change  is  independent  on  the  type  of  optimization  problem.  A 
sensitivity  analysis  can  be  performed  in  order  to  see  how  much  a  bound 
can  change  on  a  variable  before  the  problem  is  no  longer  optimal  and 
feasible. 

BASIC  VARIABLE  BOUNDS 

The  part  of  the  optimal  program  affected  by  changing  the  bound  on  a 
basic  variable  is  l*Xg  B"^N*Xj.^  =  B’^b.  The  bounds  on  basic  variables 

are  >=  0  for  d  linear  program.  The  changing  of  the  bounds  from  Xg  >=  0  to 

some  bound  other  than  0  will  affect  the  feasibility  of  the  optimal 
solution.  The  lower  bound  for  a  basic  variable  can  decrease  without  bound. 
The  only  bound  restricting  the  basic  variable  is  the  upper  bound  which 
specifies  how  high  the  basic  variable  can  be  restricted.  In  the  optimal 
system  the  non-basic  variables  are  equal  to  zero  so  are  unaffected  by  the 
bound  of  the  basic  variable.  In  order  to  see  how  high  the  bound  on  a  basic 

variable  can  be,  the  part  of  the  affected  optimal  system  can  be  reduced  to 
l*Xg  =  B‘^b.  In  order  to  maintain  feasibility  and  optimality,  the  upper 

bound  on  Xg  cannot  be  greater  than  B’^b,  the  optimal  value  of  the  basic 


variable,  or  the  problem  becomes  infeasible. 

NON-BASIC  VARIABLE  BOUNDS 

The  part  of  the  optimal  system  which  is  affected  by  the  bound  of  the 
non-basic  variables  is  l*Xg  +  B“  N*X^  =  B‘  b  and  X^^  >=  0.  When  the  bound 

changes  on  a  non-basic  variable,  the  value  of  the  respective  basic  variable 
must  change  accordingly  in  order  to  maintain  feasibility.  In  order  to  find 

the  upper  and  lower  bounds  on  a  non-basic  variable,  the  affected  part  of 
the  optimal  system  becomes  =  (B  b  -  Xg)/B  N  where  B  N  is  the 

column  of  the  B“^N  matrix  corresponding  to  the  non-basic  variable  of 
interest,  and  Xg  is  the  lower  bound  of  the  corresponding  basic  variable.  In 

order  to  maintain  feasibility,  (B'^  b  -  Xg)/B“^  N  must  be  greater  than  or 

equal  to  zero.  Therefore,  the  bound  on  X^^  cannot  exceed  (B”^  b  -  Xg)/B"^  N 

because  (B‘^  b  -  Xg)/B"^  N  -  X^  must  be  >=  0.  The  bound  on  the  non-basic 

variable  can  be  decreased  to  a  lower  bound  and  increased  to  an  upper 
bound. 

Upper  Bound  for  a  Non-Basic  Variable 

The  upper  bound  for  a  non-basic  variable  cannot  exceed  the  minimum 
-1  1  1 

of  the  elements  of  (B  b  -  Xg)/B  N  if  the  B  N  elements  are  positive. 

The  positive  coefficients  of  positive  non-basic  variables  will  drive  the 
corresponding  basic  variable  to  its  lower  bound.  If  the  B‘^N  elements  are 
negative,  then  the  bound  on  the  non-basic  variable  can  increase  without 
bound  because  the  corresponding  basic  variable  will  only  be  forced  to  be 
more  positive  to  maintain  feasibility  and  optimality. 
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Lower  Bound  for  a  Non-Basic  Variable 

The  lower  bound  for  a  non-basic  variable  cannot  get  lower  than  the 
maximum  of  the  elements  of  (B'^b  -  Xg)/B"^N  if  the  B’^N  elements  are 

negative.  The  negative  coefficients  of  negative  non-basic  variables  will 

drive  the  corresponding  basic  variable  to  its  lower  bound.  If  the  B"^N 

elements  are  positive,  then  the  bound  on  the  non-basic  variable  can 

decrease  without  bound  because  the  corresponding  basic  variable  will  only 

be  forced  to  be  more  positive  to  maintain  feasibility  and  optimality. 

The  program  listed  in  Appendix  A.7  performs  a  sensitivity  analysis 

on  the  bounds  of  basic  and  non-basic  variables.  For  analysis  on  a  basic 

variable  bound,  the  program  requires  as  input  the  current  optimal  RHS 

vector  and  the  position  of  the  basic  variable  of  interest  in  the  RHS  vector. 

The  analysis  for  a  non-basic  variable  bound  requires  as  input  the  current 

optimal  RHS,  the  B"^N  matrix  of  the  optimal  system,  and  the  column  of 

the  B"^  N  matrix  corresponding  the  non-basic  variable  of  interest.  The  B" 

1 

N  matrix  is  the  constraint  coefficients  of  the  non-basic  variables  in  the 
optimal  system. 


26 


Conclusion 

The  concepts  introduced  in  this  paper  are  emphasized  by  respective 
computer  programs.  These  programs  are  built  for  the  purpose  of 
furthering  the  students'  understanding  of  these  concepts. 
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[*  Generates  all  possible  basis  *] 

[*  A  matrix  contains  slack  variables,  no  non-negativity  constraints  *] 

A  =  {{1, 1,2, 1,0,0}, {1,3, 1,0, 1,0), {-1,1, 1,0, 0,1)}; 
b  =  {9,2,4); 

n=  3;  ffi=  3;  totvar  =  n+m; 

Ra  =  Range [1, totvar ] ; 
basis  *=  Subsets [Ra,m] ; 

For [ i=l, i<=Cardinality[ basis] , i++, 
set*Extract [basis , i ] ; 

Ab  =  GetColumn[A, set] ; 
soln  =  Inverse[Ab] .b; 

If[soln  ==  {},  Print[set,”  is  not  an  independent  basis!  ”]  ]; 

Bfs  =  {}; 

For  [j=l,  j<=  totvar,  j++, 

Bfs  =  Append [Bf s, 0] ; 

]; 

For  [j=l,  j<=m,  j++, 
pos  =  Extract [ set, j ] ; 
posval  =  Extract[soln, j ] ; 

Bfs  ==  Insert[Bfs, posval, pos] ; 

]; 

Bfs  =  Drop [Bfs,  -m] ; 

Print ["Basis  ",i,"  =  ",set]; 

Print ["BFS  ",i,"  =  ",Bfs]; 

3; 


Appendix  A. 2 


Generation 


f  all  possible  extreme  points 
by 

2Lt  Wendy  Cook 
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09; 
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13: 
D14: 
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[*  Generate  all  possible  extreme  points  *] 

[*  A  matrix  contains  no  slack  variables  but  includes  nonneg  constraints  *] 

A  =  {(1, 1,2}, {1,3,1}, {-1,1,1}, {1,0,0}, {0,1,0}, (0,0,1)}; 

At  =  Transpose [A] ; 
b  =  {9,2,4,0,0,0} ; 
n=3  ;m==6 ; 

R  =  Range [l,m] ; 
cols  =  Subsets [R, n] ; 

For  [i=l,  i<=  Cardinality [cols ] ,  i++, 
s=  cols[ [ i] ] ; 
rows  =  GetColumn[At, s] ; 
rowt  =  Transpose [ rows ] ; 
bt  =  Extract [b, s] ; 

Print ["Constraints  ",s, 

]; 


II 


Extreme  Point  ” , Inverse [rowt] .bt] : 


MOR/ML  Output 


J^nstraints 

{ 

1, 

2, 

3) 

Extreme 

Point 

{0.00,-1.00,5.00} 

■onstraints 

{ 

1, 

2, 

4} 

Extreme 

Point 

{0.00,-1-00,5.00} 

Constraints 

{ 

1, 

2, 

5} 

Extreme 

Point 

{-5.00,0.00,7.00} 

Constraints 

{ 

1, 

2, 

6} 

Extreme 

Point 

{12.50,-3.50,0.00} 

Constraints 

{ 

1, 

3, 

4} 

Extreme 

Point 

{0.00,-1.00,5.00} 

Constraints 

{ 

1, 

3, 

5) 

Extreme 

Point 

{0.33,0.00,4.33} 

Constraints 

{ 

1, 

3, 

6} 

Extreme 

Point 

{2.50,6.50,0.00} 

Constraints 

{ 

1, 

4, 

5} 

Extreme 

Point 

{0.00,0.00,4.50} 

Constraints 

{ 

1, 

4. 

6} 

Extreme 

Point 

{0.00,9.00,0.00} 

Constraints 

{ 

1, 

5, 

6} 

Extreme 

Point 

{9.00,0.00,0.00} 

Constraints 

{ 

2, 

3, 

4} 

Extreme 

Point 

{0.00,-1.00,5.00} 

iConstraints 

{ 

2, 

3, 

5} 

Extreme 

Point 

{-1.00,0-00,3.00} 

Constraints 

{ 

2, 

3, 

6} 

Extreme 

Point 

{-2.50,1.50,0.00} 

Constraints 

{ 

2, 

4, 

5} 

Extreme 

Point 

{0.00,0.00,2.00} 

Constraints 

{ 

2, 

4, 

6} 

Extreme 

Point 

{0.00,0.67,0.00} 

Constraints 

{ 

2, 

5, 

6} 

Extreme 

Point 

{2.00,0.00,0.00} 

Constraints 

{ 

3, 

4, 

5} 

Extreme 

Point 

{0.00,0.00,4.00} 

Constraints 

{ 

3, 

4, 

6} 

Extreme 

Point 

{0.00,4.00,0.00} 

Constraints 

{ 

3, 

5, 

6} 

Extreme 

Point 

{-4.00,0.00,0.00} 

Constraints 

{ 

4, 

5, 

6} 

Extreme 

Point 

{0,00,0.00,0.00} 

Appendix  A. 3 


Generation 


an  extreme  point  given  a  basis 
by 

2Lt  Wendy  Cook 


30 
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|01 
|02 
l03 
>04 
>5 
|06 
>07 

108 
09 
10 
>11 
(l2 
\l3 
>14 
fl5 
(l6 
>17 
>18 
jl9 
>20 
321 
f22 
f23 
)24 
ps 
26 
>27 
}2B 
29 

bo 

>31 

>32 

>33 


[*  Given  a  basic  feasible  solution,  BFS,  an  extreme  point  is  given  *] 
[*  A  matrix  includes  slack  variables,  no  non-negativity  constraints  *] 

A  =  {{1, 1,2, 1,0,0}, {1,3, 1,0, 1,0}, {-1,1, 1,0,0, l}); 
b={9,2,4}; 

Basis  =  {1,2,4} ; 

Ab  =  GetColumn[A,Basis] ; 

Soln  =  Inverse[Ab] .b; 

If[Soln  ==  {}  ,Print[ Basis,  ”  is  not  an  independent  basis!  •*]  ]; 
n=3 ;m=3 ; 
totvar=  n+m; 

BFS  =  {}; 

For [ i=l , i<=  t otvar ,  i++ , 

BFS  =  Append [ BFS , 0 ] ; 

]; 

For[i=l, i<=m, i++, 

pos=Extract[Basis, i] ; 
posval=Extract[Soln, i] ; 

BFS=Insert [ BFS , posval , pos ] ; 

]  ? 

BFS  =  Drop[BFS, -m] ; 

Print  C  ''BFS=  ” ,  BFS  ]  ; 

Rn  =  Range [l,n]; 

Extpo int  =  Extract [ BFS , Rn ] ; 

Print ["Extreme  point  =  ",Extpoint]; 

[*  Which  constraints  are  tight  *] 

For[i=n+i,  i<=:  totvar,  i++, 
slackval  =  Extract [ BFS , i ] ; 

If[slackval  ==  0,  Print ["Constraint  ",i-n,"  is  tight"]  ]; 

]; 


MOR/ML  Output 


IP’S*  {-2.50,1.50,  0,10.00,  0,  0} 
Ktreme  point  =  {-2.50,1.50,  0} 
onstraint  2  is  tight 
Constraint  3  is  tight 


Appendix  A. 4 


Generation  of  a  basis  for  a  given  extreme  point 

by 

2Lt  Wendy  Cook 
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fOOOl 

S02 

03 

0004 

»05 
06 
07 

0008 

SOB 
10 

0011 

112 
13 
0014 

Wl7 

0018 

S19 
20 

0021 

*22 
23 
24 

125 
26 
27 

0028 

•29 


[*  A  basis  is  generated  from  a  given  feasible  extreme  point  *] 

[*  The  A  matrix  contains  slack  variables,  no  non-negativity  constraints 

A  =  {{1, 1,2, 1,0,0}, {1,3, 1,0, 1,0), {-1,1, 1,0, 0,1}}; 
b  =  {?,2,4}; 

n=3;  [*  number  of  original  variables  — no  slacks  *] 

m=3 ; 

Rn  =  Range [ 1 , n ] ; 

Extpoint  =  {-2.5,1.5,0} ; 

For [ i=l , i<=m , i++ , 

Extpoint  =  Append [Extpo int, 0] ; 

]  ? 

BFS  =  Extract [Extpoint, Rn] ; 

For[i=l,i<=  Cardinality [A] , i++, 
const  =  Extract [A, i] ; 

Rhs  =  Extract [b, i] ; 
constval  =  const. Extpoint; 
slack  =  i  +  n; 
slackval  =  Rhs  -  constval; 

BFS  =  Append[BFS, slackval] ; 

]; 

Basis  ={ } ; 

For[i=l, i<=  Cardinality [Extpoint] , i++. 

If [Extract [BFS, i] 1=0,  Basis  =  Append [ Bas i s, i]  ]; 

]? 

Print [ "BFS  =  " , BFS ] ; 

Print["Basis  =  ", Basis]; 


*] 


MOR/ML  Output 


00,0.00,0.00) 


Appendix  A. 5 


Simplex  Algorithm  in  matrix  form 
by 

Dr.  Bryan  L.  Deuermeyer 
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- + 

The  Simplex  Algorithm  in  Matrix  Form 

4- - 

simplexAlgorithm[c,a,bj  :==  Block[ 

{ m , n , Binv , cB , basis , i , z , x , ok , optimal , unbounded ) , 

[*  Ass\ime  each  row  has  a  slack  variable  *] 
ok  =  0; 
optimal  *=  1; 
unbounded  =  2; 

setupLP[]  :=  Block[{i), 
m  =  Cardinality [b ] ; 
n  =  Cardinality [c] ; 

Binv  =  IdentityMatrix[m] ; 
basis  =  n  +  Range [m] ; 
a  =  JoinColumns[  a, Binv]; 
c  =  Join[c,Table[0, {i,m} ]  ]; 
cB  =  Extractt c, basis] ; 

]? 

getLeavingVariable[aa,bb] :=  Block[{r,p), 
pdivf {den,num>]  :=  If [den>0.0,num/den, Infinity] ; 

{r,p}  ®  MinList[  Map[pdiv, Transpose [ {aa,bb} ], 1]  ] ; 
lf[r<0.0,  Return[0],  Return[p]  ]; 

]? 

doPivot[pr,pc,abar]  :=  Block[ {p,alfa,t) , 

p  =  1.0/abar[ [pr] ] ; 

alfa  =  -p  abar; 

alfa[[pr]]  =  p; 

t  =  IdentityMatrix[m] ; 

t[[pr]]  =  alfa; 

Binv  =  Transpose [t] .Binv;  [*  Binv  =  E.Binv  *] 
basis [ [pr] ]  =  pc; 
cB[[pr]]  =  ct[pc]]; 

3? 

getEntcringVariable[cbar]  :=  Block [ {maxZ, pc) , 

{maxZ,pc}  =  MaxListfcbar] ; 

IfC  maxZ  <=  0.0,  Return[0],  Return[pc]  ]; 

]; 


simplexStep[w] :=  Block [ {pc,pr,abar) , 

If[w!=ok,  Break[w]  ]; 

pc  =  getEnteringVariable[cB.Binv.a  -  c] ; 

If[  pc  ==  0,  Break [optimal]  ]; 

pr  «  getLeavingVariable [  abar=Binv.GetColumn[a,pc] ,  Binv.b]; 
If[  pr  ==  0,  Break [unbounded]  ]; 
doPivot[pr,pc,abar] ; 

Return [ok] ; 


161 
62 
63 
0064 

f65 
66 
0067 

»68 
69 
70 
0^71 
•72 
m73 
0074 

«75 
76 
0077 
|A78 
•79 


setupLP[ ] ; 

Iff  Nest[siinplexStep,ok,  100]  ==  2, 
Return [ "Unbounded" ] 

3; 

bbar  =  Binv.b; 
z  =  cB.bbar; 

X  =  TablefO.O,  {i,n+in)] ; 

For[i=l, i<=m, i++, 

x[[  basisfti]]  ]]  =  bbar[[i]] 

3; 

Return [ {x,2) ] 

3; 

[* - 

Now  Solve  a  Problem 
+ - 

a=  {{1, 1,2}, {1,3,1), {-1,1,1}}; 
c=  {1,1, -4}; 
b*  {9,2,4}; 

simplexAlgor ithm [ c , a , b ] : 


MOR/ML  Output 


74:  { {0.00,0.00,2.00,5.00,0.00,2.00} 


8.00 


Appendix  A. 6 

Altered  simplex  algorithm  in  matrix  form 

by 

Dr.  Bryan  L.  Deuermeyer 
altered  by  2Lt  Wendy  Cook 


The  function  calls  getEnteringVariable  and 
getLeavingVariable  are  changed  in  order  to  allow  the  students  to 
select  the  variables. 
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01:  [* - - 7 - - 

02:  The  Simplex  Algorithm  in  Matrix  Form 

03:  + -  - *1 

04: 

05:  simplexAlgorithm[c,a,b]  :=  Block [ 

06 :  {m , n , Binv , cB , basis , i , z , x , ok , optimal , unbounded , pr , pc ) , 

07:  [*  Assume  each  row  has  a  slack  variable  *] 

08:  ok  =  0; 

09:  optimal  =1; 

10 :  unbounded  =  2 ; 

11; 

12: 

13:  setupLP[]  :=  Block[{i}, 

14:  m  =  cardinality [b] ; 

15:  n  =  Cardinality [c ] ; 

16:  Binv  =  IdentityMatrix[m] ; 

17:  basis  =  n  +  Range [m] ; 

18:  a  =  JoinColumns[  a, Binv]; 

19:  c  =  Join [c, Table [ 0, (i,m} ]  ]; 

20:  cB  =  Extract [c, basis ] ; 

21:  ]; 

22: 

23:  [*  getLeavingVariable[aa,bb} :=  Block[{r,p), 

24:  pdiv[ {den,num} ]  :=  If [den>0. 0,num/den, Infinity] ; 

25:  {r,p)  =  MinList[  Map[pdiv,Transpose[ {aa,bb} ] , 1]  ]; 

26:  lfi;r<0.0,  Return[0],  Retum[p]  ]; 

27:  ];  *] 

28: 

29:  doPivot[pr,pc,abar]  :=  Blockt {p,alfa,t} , 

30:  p  =  1. 0/abar[ [pr] ] ; 

31:  alfa  =  -p  abar; 

32:  alfa[[pr]]  =  p; 

33:  t  =  IdentityMatrix[m] ; 

34:  t[[pr]]  -  alfa; 

35:  Binv  =  TransposeCt] .Binv;  [*  Binv  =  E.Binv  *] 

36:  basis[[pr]]  =  pc; 

37;  cB[[pr]]  *  c[[pc]]; 

38:  ]; 

39: 

40:  [*  getEnteringVariabletcbar]  :=  Block[ {maxZ,pc} , 

41:  (maxZ,pc}  =  MaxList[cbar] ; 

42:  If[  maxZ  <=  0.0,  Return[0],  Return[pc]  ]; 

43:  ];  *] 

44: 

45;  simplexStepr ] :=  Block [ (pc, pr, abar) , 

46:  [*  Iftwl=ok,  Break[w]  ];*] 

47:  pc  =  1;  [*  getEnteringVariable[cB.Binv.a  -  c];*] 

48:  [*  If[  pc  ==  0,  Break [ optimal ]  ];*] 

49:  pr  =  1;  [*  getLeavingVariable[  abar=Binv.GetColumn[a,pc] ,  Binv.b];*] 

50:  abar  =  Binv.GetColumn[a,pc] ; 

51:  [*If[  pr  “  0,  Break [unbounded]  ];*] 

52:  doPivot[pr,pc,abar] ; 


>53 
)54 
>55 
[56 
)57 
>58 
59 
ko 
>61 
f62 

163 
>64 
>65 

f66 

>67 
>68 
69 
>70 
>71 
>72 
>73 
)74 
)75 
>76 
)77 
>78 
>79 
>80 
1081 
>82 
>83 
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>85 
>86 
>87 
[088 
>89 
>90 
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>92 
>93 
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>95 
>96 
)97 
[098 
>99 
LOO 
[101 
L02 
L03 
L04 
L05 
L06 
L07 
[108 
L09 
LIO 
[111 
L12 


[*Return[ok] ;  *] 

3? 

setupLP[] ; 
simplexStep[ ] ; 

[*If[  Nest[siinplexStep,ok,  100] 
[ *Return [ "Unbounded" ] * ] 

[*];*] 

bbar  =  Binv.b; 
z  =  cB.bbar; 

X  *=  Table[0.0,  {i,n+in}  ]  7 
For[i=l/  i<=2n,  i++, 
x[[  basis[[i]]  ]]  =  bbar[[i]] 
]? 

Retum[{x,z}] 

3; 


=*  2, *3 


Now  Solve  a  Problem 


a  =  {{1,1,2}, {1,3,1}, {-1,1,1}}; 
c  =  {l,l,-4}; 
b  *  {9,2,4); 

siniplexAlgorithia[c,a,b] : 


MOR/ML  Output 
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014: 

pl5: 

)16: 
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[*  Right-hand  side  *] 

LowBound[Binv,bbar,d] :-  Blcck[ {n,p) , 
dbar  =  Binv.d; 

rdiv[ {num,den} ] :=  If [den>0.0,  -  num/den,  -Infinity]; 

{n,p)  =  MaxList[  Map[rdiv,Transpose[ {bbar,dbar} ] , 1]  ]; 
Return [n] ; 

3; 


UpperBound[Binv,bbar,d] :=  Block [ {n,p} , 
dbar  =  Binv.d; 

rdiv[ {num,den} ] :=  lf[den<0.0,  -num/den.  Infinity]; 

{n,p}  =  MinList[  Map[rdiv,Transpose[ {bbar,dbar} ] , 1]  ]: 

Return [n] ; 

]7 

Binv  =  {{0.5,  0.2,  -1},  {-1,  1,  0.5),  {5,  -0.3,  2)); 
bbar  =  {2,3,1); 
d  =  {1,0,0}; 

"This  element  of  the  RHS  can  be  decreased  by  " :LowBound[ Binv, bbar, d] : 
"This  element  of  the  RHS  can  be  increased  by  ":UpperBound [Binv, bbar, d] 

[*  Cost  Coefficients  *] 

NonBasCoeff [RCosts,RedCostpos] :=  Block[ (value) , 
value  =  Extract [RCosts, RedCostpos] ; 

Return [value] ; 


>29:  ]; 

>30: 

031:  LowBasCoeff [RCosts, BinvNRow] :=  Block[{r,p), 

>32:  Low[ { frow, srow) ] :=  lf[srow<0.0,  frow/srow,  -Infinity]; 

>33:  (r,p)  =  MaxListf  Map [ Low, Transpose[ (RCosts, BinvNRow) ], 1]  ]; 

>34:  Return [r] ; 

035:  ]; 

>36: 

>37:  HighBasCoeff [RCosts, BinvNRow] :=  Block[(r,p), 

038:  High[ (frow,srow) ] :=  lf[srow>0.0,  frow/srow,  Infinity]; 

139:  {r,p)  =  MinList[  Map [High, Transpose[ (RCosts, BinvNRow) ], 1]  ]; 

140:  Return[r]; 

041:  ]; 

>42: 

143:  RCosts  =  (1,  2,  3); 

>44:  BinvNRow  =  (-1,  1,  2); 

>45:  RedCostpos  =  1; 

>46:  "This  basic  coefficient  can  be  decreased  by  ": 

>47 :  LowBasCoeff [RCosts , BinvNRow] : 

048:  "This  basic  coefficient  can  be  increased  by  ": 

>49 ;  HighBasCoeff [RCosts, BinvNRow] : 

150:  "This  nonbasic  coefficient  can  be  decreased  by  ": 

>51:  NonBasCoeff [RCosts, RedCostpos] : 


[*  Bounds  *] 


BasVar[bbar,BasicRow] :=  Block[ {Bound} , 
Bound  *  Extract [bbar, BasicRow] ; 
Return [Bound] ; 

]; 


UpNonBasVar[bbar,BinvN,VarCol] ;=  Block[ {r,p,ncol} , 
ncol  =  GetColuinn[BinvN,VarCol] ; 

Upper [ (num, den} ] :=  lf[den>0.0,  num/den,  Infinity]; 

{r,p}  =  MinList[  Map[Upper, Transpose [ {bbar, ncol }], l]  ] ; 
Return [r] ; 

]; 

LoNonBasVar [ bbar , BinvN , VarCol ] : =  Block [ { r , p , ncol } , 
ncol  =  GetColumn [BinvN, VarCol ] ; 

Lower [ {num, den} ] :=  lf[den<0.0,  num/den,  -Infinity]; 
{r,p)  =  MaxList[  Map[Lower,Transpose[ {bbar,ncol} ] , i]  ]; 
Return[r] ; 

]; 


bbar  =  {10,  10}; 

BasicRow  =  2; 

BinvN  *=  {{-7,  -5,  -0.667),  {0,8,  0.6,  -0.0667}}; 

VarCol  =  2 ; 

'•The  lower  bound  on  this  basic  variable  can  be  increased  by 
BasVar[ bbar, BasicRow] : 

"The  lower  bound  on  this  nonbasic  variable  can  be  increased  by 
UpNonBasVar [ bbar , BinvN , VarCol ] ; 

"The  lower  bound  on  this  nonbasic  variable  can  be  decreased  by 
LoNonBasVar [bbar, BinvN, VarCol] : 


MOR/ML  Output 


This  element  of  the  RHS  can  be  decreased  by 
-0.20 

This  element  of  the  RHS  can  be  increased  by 
3 

This  basic  coefficient  can  be  decreased  by 
-1 

This  basic  coefficient  can  be  increased  by 
1.50 

This  nonbasic  coefficient  can  be  decreased  by 
1 

The  lower  bound  on  this  basic  variable  can  be  increased  by 
10 

The  lower  bound  on  this  nonbasic  variable  can  be  increased  by 
16.67 

The  lower  bound  on  this  nonbasic  variable  can  be  decreased  by 
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